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(57) The present invention discloses a sound envi- 
ronment simulator including a sound field 
analyzing unit a sound field reproducing unit, 
and an output unit. The sound environment 
analyzing unit divides the solid surfaces of a 
space to be analyzed into a set of sections to 
compute the volume of reflected sounds with a 
sound absorption coefficient of walls and form 
factors. It further computes time series data 
related to the arrival volume of sounds ema- 
nated from a certain sound source to the sound 
receiving point An impulse response comput- 
ing unit in the sound field reproducing unit 
transduces the time series data into an impulse 
response. Accordingly, the sound field repro- 
ducing unit con volutes the impulse response on 
a dry source in accordance with data related to 
a listener's position inputted from an associated 
virtual reality equipment to generate a repro- 
duced sound over a headphone. 
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BACKGROUND OF THE INVENTION 

(1) Field of the Invention 

The present invention relates to a sound environ- 5 
ment simulator which enables one to experience a 
computer simulation of sound performance when 
modeling acoustic affects in a listening room, a con- 
cert hall or the like, and to a method of analyzing spa- 
tial acoustic characteristics of a sound space. 10 

(2) Description of the Related Art 

Rapid advancement in the field of audio-visual 
technology makes it possible to supply high-quality 15 
music and images to individual homes. In particular, 
what has been attracting people's interest is a techni- 
que, a so-called "home theater", by which one can en- 
joy a movie or music at home as if he were in a movie 
theater or a concert hall. To enjoy the home theater, 20 
it is desirable to have a room where acoustic affects 
and sound insulation effects are well taken into ac- 
count However, in most of the cases, people enjoy 
movies and music in their living rooms where a variety 
of furniture and household appliances are installed. 25 
Thus, nowadays, not only the appearance and the 
feeling of being comfortable, but also the acoustic af- 
fects and insulation effects are important elements 
when designing for living rooms. 

Conventionally, data related to acoustic charao 30 
teristics are evaluated for modeling acoustic affects: 
they are computed by either experimental or analyti- 
cal method and then fed back to design specifica- 
tions. 

In the experimental method, a model room is con- 35 
structed, and an impulse response is measured di- 
rectly to compute the acoustic characteristics data of 
the model room. However, the costs both for building 
materials and labor do not allow its application to in- 
dividual house construction. 40 

Whereas in the analytical method, the acoustic 
characteristics data are computed by a computer as 
it simulates a three dimensional sound field. This 
method has been widely used in recent years. Be- 
cause the resulting data reliably correspond to van- 45 
ous input conditions, become a reliable source for fur- 
ther analysis, and facilitate further processing and 
feedback to the design specifications. 

Data necessary for simulating the three dimen- 
sional sound field are computed either by a numerical 50 
analysis or a geometric analysis based on theory of 
acoustics: sound waves are taken into account in the 
former, whereas they are not in the latter. 

A finite element method(FEM) and a boundary 
element method(BEM) are typically used in the nu- 55 
merical analysis. In both the methods, the computer 
computes acoustic intrinsic modes or pressure distrib- 
ution of a sound by solving a dominance equation of 
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a stationary sound field, or namely Helmholtz's equa- 
tion. Taking the sound waves into account makes it 
possible to analyze diffraction and interference of the 
sound; however, it does not allow the computation of 
a non-stationary value such as an echotime pattern. 
In particular, to compute the echotime pattern of a 
high frequency sound, a myriad number of lattices are 
involved, so that not only it takes relatively long, but 
also the amount thereof exceeds a memory capacity. 
For this reason, the numerical analysis has not been 
applied to practical applications. 

On the other hand, in the geometric analysis 
based on the theory of acoustics, methods using 
sound rays or virtual images are typically used on the 
premise that the sound rays are reflected geometri- 
cally from walls. These methods are practical; for the 
memory capacity does not limit the amount of the 
computation. However, this analysis does not guaran- 
tee accuracy in all cases. For example, the resulting 
data may not be accurate when simulating the sound 
field with a low frequency sound in a room where a 
wave length is longer than its size. Because given 
these circumstances, the sound rays fail to reflect in 
accordance with the premise. 

In addition, a reverberation time, which is a critical 
element to compute the acoustic characteristics data, 
is approximated by Sabine's or Eyring's equation to 
minimize the amount of computation for the sound ray 
tracing. Such an approximation causes an computa- 
tion error when this analysis is applied to a space 
where a variety of household appliances are to be in- 
stalled or whose shape is complex. 

Another type of sound environment simulator has 
been developed in recent years. This type of simula- 
tor simulates a sound field by reproducing a sound in 
accordance with the acoustic characteristics data, so 
that one can hear the reproduced sound. In a broad 
sense, the sound environment simulator includes a 
model room where one can listen to a sound repro- 
duced over speakers installed therein. However, this 
type of simulator is not applicable for individual house 
construction. 

Accordingly, a sound environment simulator, dis- 
closed in U.S. patent application No. 4,731,848, was 
proposed. This simulator is designed to reproduce a 
sound over a headphone with reverberation effects. 
More precisely, an input audio signal is branched and 
the branched signal is inputted into a delay circuit. 
Then, the delay circuit delays the output of the 
branched signal for latency comparable to the time 
difference of the reflected sound to produce a rever- 
berant signal. Subsequently, the original input audio 
signal and reverberant signal are composited to gen- 
erate an output signal which is transduced into a 
sound. However, the sound reproduced in this way 
may give an impression to a listener that it does not 
sound realistic; for the sounds of higher order reflec- 
tions (i.e. the sounds reflected for a number of times) 
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are discarded. 

Moreover, this type of simulator does not repro- 
duce the sound immediately. This is because index 
data such as locations of a virtual sound source and 
the listener are inputted manually each time they 
move. Furthermore, the shape of a space selected as 
a model environment is limited. 

SUMMARY OF THE INVENTION 

Accordingly, the present invention has an object 
to provide a sound environment simulator which en- 
ables a listener to experience a simulation of sound 
environment of a space selected as a model environ- 
ment without constructing the model space. 

The present invention has another object to pro- 
vide a sound environment simulator which can repro- 
duce a sound in accordance with changes in acoustic 
characteristics associated with dynamic changes 
such as a listener's position or direction of his head. 

The above objects are fulfilled by a sound envir- 
onment simulator which comprises an echotime pat- 
tern computing unit, an impulse response computing 
unit, a sound reproducing unit, and an output unit. The 
echotime pattern computing unit computes an echo- 
time pattern for a specific space to be analyzed by a 
geometric analysis based on the theory of acoustics 
with data related to conditions of the specific space. 
The impulse response computing unit computes a re- 
sponse for each frequency band from the echotime 
pattern, and composites all the responses together to 
generate an impulse response. The sound reproduc- 
ing unit convolutes the impulse response on non-re- 
verberant sound source data to generate reproduced 
sound data which are further outputted as a sound 
from the output unit. 

According to the above construction, the sound 
environment simulator can analyze the acoustics 
across a broad range of frequencies, thereby ena- 
bling the reproduction of a sound field at any desired 
location within a space of any shape. 

The sound environment simulator may include a 
location data detecting unit for detecting at least one 
of the location of a listener's head or its direction. The 
sound reproducing unit may extract the impulse re- 
sponse and a head transfer function corresponding to 
the detected location data, and convolute them on the 
non-reverberant sound source data to generate the 
reproduced sound data. The head transfer function is 
a parameter stored in a memory in advance that rep- 
resents the change in an incident sound in accor- 
dance with the shape of the head and a location of 
ears. 

According to the above construction, the sound 
environment simulator can produce a sound field ade- 
quately corresponding to changes in the sound asso- 
ciated with dynamic changes such as the change of 
the listener's position or his head direction. The sound 



field thus reproduced gives the listener an impression 
as if he were in the specific space. 

Further, the present invention has another object 
to provide a method of analyzing a sound space for 
5 computing spatial acoustic characteristics data to- 
gether with the effects of the sounds of higher order 
reflections. 

The above object is fulfilled by a method of ana- 
lyzing a sound space comprising the steps of setting 

10 analysis conditions including the shape of the specif- 
ic space and physical data of surfaces, a set of certain 
sections by dividing the surfaces, a virtual sound 
source and a virtual sound receiving point, computing 
time series data of arrival volume of the sound eman- 

15 ated from the sound source to the sound receiving 
point for each incident direction and frequency band, 
and computing an echotime pattern by interpolating 
certain data to the time series data of the arrival vol- 
ume. 

20 The method may further comprise the steps of 
computing an echotime pattern for each frequency 
band using a geometric analysis based on the theory 
of acoustics at the sound receiving point, convoking 
the echotime patterns by a bandpass filter for each 

25 frequency band to compute a response for each fre- 
quency band to composite all the responses together 
to form an impulse response, detecting location data 
of a listener, receiving a dry source(the sound record- 
ed in an anechoic room) of the sound source, produc- 

30 ing a reproduced sound data by convoluting the im- 
pulse response and a head transfer function corre- 
sponding to the detected location data on the dry 
source, and transducing the reproduced sound data 
into a sound. 

35 The above method makes it possible to compute 
the data related to the sound of the higher order re- 
flections, which further enables a precise prediction 
of a reverberation time from the time series data of the 
arrival volume. Moreover, the impulse response data 

40 corresponding to any location of the listener and di- 
rection of his head can be analytically computed. As 
a result, a realistic sound field can be reproduced by 
means of a virtual reality (VR) equipment. 

45 BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects, advantages and fea- 
tures of the invention will become apparent from the 
following description thereof taken in conjugation with 
50 the accompanying drawings which illustrate specific 
embodiments of the invention. In the drawings: 
Fig. 1 is a block diagram of the sound environ- 
ment simulator of the present invention; 
Fig. 2 is a block diagram of the sound environ- 
55 ment simulator in accordance with the first em- 

bodiment; 

Fig. 3 is a flowchart detailing the operation of the 
sound environment analyzing unit 1; 
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Fig. 4 is a flowchart detailing the sub-routine of 
the step for computing the echotime pattern in 
Fig. 3; 

Fig. 5 is an illustration depicting the model space 
used by the echotime pattern computing unit 15; 
Fig. 6 is another illustration depicting the model 
space used by the echotime pattern computing 
unit 15; 

Fig. 7 (a) is a graph of the time series data of the 
actual arrival volume at one of the divided sec- 
tion; 

Fig. 7(b) is another graph of the time series data 

of the arrival volume divided into a set of groups 

at one of the divided section; 

Fig. 8(a) is a graph of the time series data of the 

actual arrival volume at the sound receiving 

point; 

Fig. 8(b) is a graph of the time series data of the 
arrival volume divided into a set of groups at the 
sound receiving point; 

Fig. 8(c) is a graph of the time series data of the 
arrival volume interpolated with a certain 
data(echotime patter) at the sound receiving 
point; 

Fig. 9 is a block diagram detailing the construc- 
tion of the sound field reproducing unit 2 and out- 
put unit 3; 

Fig. 10 is a block diagram detailing the construc- 
tion of the impulse response computing unit 21; 
Fig. 11 is a flowchart detailing the operation of 
the impulse response computing unit 21; 
Fig. 12 is a flowchart detailing the operation of 
the sound field reproducing unit 2 in Fig. 9; 
Fig. 13 is a block diagram of the sound environ- 
ment simulator in accordance with the second 
embodiment; and 

Fig. 14 is a block diagram of the sound environ- 
ment simulator in accordance with the third em- 
bodiment 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[First Embodiment] 

A sound environment simulator in accordance 
with the first embodiment reproduces a realistic, ster- 
eophonic sound by computing data related to acoustic 
characteristics in a virtual space created as a model 
environment, so that a listener can experience a sim- 
ulation of a sound field. 

The sound environment simulator, as is shown in 
Fig. 1, comprises a sound environment analyzing unit 
1 , a sound field reproducing unit 2, and an output unit 
3. The sound environment analyzing unit 1 analyzes 
the acoustic characteristics in the virtual space by 
means of computer simulation to compute a echotime 
pattern. The sound field reproducing unit 2 computes 



data related to an impulse response from the echo- 
time pattern to transduce non-reverberant portion of 
a desired sound into a consecutive sound signal on 
real time. The output unit 3 includes a headphone or 

5 the VR equipment and transduces the consecutive 
sound signal into a sound. 

The above-described sound environment simula- 
tor is designed to simulate changes in the sound oc- 
curring as the listener stands up, sits down, walks 

w around in a room, or moves his head. More precisely, 
the sound environment analyzing unit 1 computes the 
echotime patterns for each location, incident direc- 
tion, and frequency of a sound source. The sound 
field reproducing unit 2 computes the impulse re- 
ts sponse from the echotime patterns, and adds further 
processing to produce a stereophonic sound signal, 
which is transduced into a sound by the output unit 3. 

Fig. 2 provides a detailed construction of the 
sound environment analyzing unit 1. It comprises a 

20 room data input unit 11 , a sound source data input unit 
12, a sound receiving point data input unit 13, a sur- 
face dividing unit 14, an echotime pattern computing 
unit 15 including a time series data computing unit 16 
and a data transducing unit 17, and a memory 18. 

25 The sound environment analyzing unit 1 com- 
putes the echotime patterns for each location in the 
virtual space, each incident direction of the sounds in- 
cident to the sound receiving point, and each sound 
source including a plurality of predetermined frequen- 

30 cy bands. 

The flowchart in Fig. 3 details the above- 
described operation. 

In Step 1 00, data related to the virtual space such 
as the shape, size and a sound absorption coefficient 

35 of walls are inputted into the room data input unit 11. 
Subsequently, data related to the location of the 
sound receiving point(location of the listener's head), 
and data related to incident direction of the sound to 
the sound receiving point are inputted atthe sound re- 

40 ceiving point data input unit 13 in Steps 110 and 120, 
respectively. Further, data related to the sound 
source such as the frequency and volume thereof are 
inputted atthe sound source data input unit 12 in Step 
130. 

45 Then, in Step 140, the surface dividing unit 14 
divides solid surfaces, or namely the walls, of the vir- 
tual space into a set of sections, and numbers them 
serially. Each section is a rectangle whose side is 
shorter than the wave length of the sounds emanated 

so from the sound source. It also sets the sound absorp- 
tion coefficient for each section from the sound ab- 
sorption coefficient inputted in Step 100, and the 
sound receiving point The sound receiving point 
takes a form of, for example, a dodecahedron to ap- 

55 proximate the listener's head. 

An example of the virtual space created in this 
way is illustrated as a model space 10 in Fig. 5. In the 
drawing, one wall is divided into approximately 400 
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sections, and the sound source is set at 500 Hz, 
whereby the short side of each section is set to 45cm. 
The sound absorption coefficient a is added to each 
section; the sound absorption coefficient ai is added 
to the section i, and qj to the section j. The frequency 5 
of the sound source is set per 1/8 octave band; for the 
sound absorption coefficient data of the walls are 
practically computed per octave band. 

Once the model space 10 is created, the echo- 
time pattern calculator 15 computes the echotime w 
pattern in Step 200, which is detailed by the flowchart 
in Fig. 4. 

In Step 210, the time series data computing unit 
1 6 computes form factors. These form factors are cal- 
culated by a radiant heat ray tracing technique, which 15 
is often used in analyzing radiation in the thermal en- 
vironment or lighting. Japanese laid-open patent ap- 
plication No. H5-52383, Hattori et al teaches the cal- 
culation method in detail. In this step, the form factors 
are calculated according to this calculation method 20 
with respect to the relations between: the sound 
source and each section; one section and another 
section; and each section and the sound receiving 
point, which are respectively referred to as Fsc, Fee 
and Fcr. 25 

The calculation of reflected sound with the form 
factors further adds reflection components having di- 
rectivity and those of mirror reflection besides perfect 
reflection components to form factors as is with the 
lighting. Thus, more realistic reflections can be simu- so 
lated by using this calculation. Also, this calculation is 
virtually a must when only an initial reflection by the 
mirror reflection at a relatively large divided section of 
a huge space such as a concert hall is roughly esti- 
mated, or when the reflection has the directivity due 35 
to the inclined walls. 

More precisely, each form factor is calculated in 
the following way: 

1) Form Factor Fsc (Sound Source Section) 

Suppose an arbitrary positioned virtual 40 
sound source S evenly emanates a plurality of 
sound rays(e.g. 100,000 rays) in all directions. 
Then, specific sections at which each sound ray 
arrives are detected. For example, with the mod- 
el space 1 0 in Fig. 5, a sound ray SRsk arrives at 45 
a section k, and sound rays SRsi 1 and SRsi 2 ar- 
rive at a section i. Accordingly, the time series 
data computing unit 16 computes the arrival vol- 
ume P1 at each section to compute P1 : Ps, PVs 
ratio to the volume of the sound source Ps, which so 
is referred to as the form factor Fsc. In this way, 
the form factors Fsc's for all the sections are cal- 
culated. 

2) Form Factor Fee (Section Section) 

For factor Fee is calculated in the same man- 55 
ner. In this case, the arrival volume to one of the 
sections is considered to be a new sound source. 

3) Form Factor Fcr (Section Sound Receiving 
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Point) 

Form factor Fa is calculated in the same 
manner. 

Once these form factors are calculated, the time 
series data computing unit 16 computes time series 
data related to the arrival volume. Note that the 
sound receiving point R receives two types of 
sounds : one is a direct sound from the sound source, 
and the other is a reflected sound from one of the sec- 
tions. Thus, the time series data computing unit 16 
computes the time series data of the direct sound 
first, thence, those of the reflected sound. For exam- 
ple, with the model space 10, the sound emanated 
along with the sound ray SRsr is the direct sound, and 
the one with the sound ray SRsk is the indirect sound. 

Back to the flowchart, the time series data com- 
puting unit 16 computes the arrival volume of the di- 
rect sound in Step 220. The arrival volume denoted as 
Pr is computed with the distance from the sound 
source to the sound receiving point R according to the 
inverse square law, while at the same time, the arrival 
time denoted as TR is computed by dividing the dis- 
tance by the speed of sound. 

Next in the Step 230, the time series data com- 
puting unit 16 computes the arrival volume of the re- 
flected sound. The amount of this computation in- 
creases a geometric series-fold, because the number 
of reflected sound rays are multiplied by the number 
of the sections each time they reflect. Thus, a mem- 
ory must have quite a large capacity to store these 
myriad computation results. To avoid this problem, 
the volume of the reflected sound is computed in two 
ways depending on the number of reflections, or 
largeness of the orders. In this embodiment, the re- 
flections up to the third order are referred to as lower 
order reflections, and the reflections beyond the third 
order reflections as higher order reflections. 

To begin with, a method for computing the arrival 
volume of the sound of the lower order refections to 
the sound receiving point R will be explained with re- 
ferring to Fig. 5. 

(The First Order Reflections) 

Let the sound rays SRsk and SRkr be examples. 
The sound along with the sound rays are emanated 
from the sound source S and incident to the sound re- 
ceiving point R by being reflected once at the section 
k. The volume thereof denoted as Pr 2 is computed 
with the form factors FsCi and F^r, and absorption 
coefficient <xk according to : 

Pr 2 = Fsc 1 x Fcyr x (1 - ctk) x Ps 

Subsequently, like with the direct sound, the dis- 
tances between the sound source S and the section 
k, the section k to the sound receiving point R are 
added and divided by the speed of sound to compute 
the arrival time T 2 . 

The above calculation is applied to all of the 
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sounds of the first order reflections. 

(The Second Order Reflections) 

Let the sound rays SRsi 2f SRij and SRjr be exam- s 
pies. The sound along with these sound rays are re- 
flected at the sections i and j before it arrives at the 
sound receiving point R. The arrival volume denoted 
as Pr 2 is computed with the form factors Fsc, FCC2 
and Fc 2 r l and absorption coefficients ai and ak ac- 10 
cording to : 

Pr 2 = Fsc x Fcc2 x Fc2r x (1 - cti)x(1 - ak)xPs 
Also, the distances between the sound source S 
and the section i, the sections i and the section j, and 
the section j to the sound receiving point R are added 15 
and divided by the speed of sound to compute the ar- 
rival time T 3 . 

The above calculation is applied to all of the 
sounds of the second order reflections. 

20 

(The Third Order Reflections) 

The volume of the sound of all of the third order 
reflections is computed in the same manner descri- 
bed as above. 25 

(The Higher Order Reflections) 

Next, a method for computing the arrival volume 
of the sound of the higher order refections to the 30 
sound receiving point R will be explained with refer- 
ring to Fig. 6. 

Let the section n be an example, then the time 
series data of the third order reflections, SRjn and 
SRmn as is shown in Fig. 7(a), have been computed 35 
at the end of the computation for the third order re- 
flections. 

These time series data are divided into a set of 
groups by a certain time interval At, for example, 0.1 
Ms. The volume of each group is added to find a sum 40 
of the time series data within each group, and the re- 
sulting data, referred to as the time series data of the 
sum, is shown in Fig. 7(b). Then, the section having 
the time series data of the sum is positioned as a new 
virtual sound source S\ In practice, at the new sound 45 
source S\ N sound rays arriving at the concerned 
section during At are composited into a single sound 
ray, so that it will have a volume equal to the sum of 
the volume of the N sound rays'. 

Back to the flowchart again, in Step 250, as is 50 
with the sound of the lower order reflections, the ar- 
rival volume along with the sound rays to either the 
sound receiving point R or another section are com- 
puted. This computation is repeated until the arrival 
volume of all the sections becomes 1/10000 of the en- 55 
tire emanated volume Ps or less. 

During the above-described computation, the 
sound receiving point R receives a large amount of 
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the direct and indirect sounds as is shown in the 
graph in Fig. 8(a). The arrival sound rays are divided 
into a set of groups as is with the higher order reflec- 
tions, for example by a certain time interval, then the 
number thereof is counted, and the arrival volume of 
each sound ray are summed up if they are plural. 

When the arrivaJ volume of all the sections be- 
comes lower than the predetermined level in Step 
250, the further computation is not proceeded. In- 
stead, such a petty arrival amount are summed up in 
each section, and these sums are further added to 
the time series data in Step 260. 

As a result, the time series data of the arrival vol- 
ume at the sound receiving point R, as is shown in Fig. 
8(b), is computed. 

Accordingly, the data transducing unit 17 com- 
putes a mean arrival volume in Step 270 to interpo- 
lates data to generate the echotime pattern from the 
time series data of the sum in the following step 280. 

More precisely, the data transducing unit 1 7 com- 
putes a mean arrival volume data as is shown in Fig. 
8(c) from the time series data of the sum. To compute 
the mean arrival volume data, the sum of the arrival 
volumes at the receiving point R within a certain 
group is divided by the number of the arrival sound 
rays. Assuming that a composite sound ray SRr con- 
sisting of N(=3) sound rays arrives to the sound re- 
ceiving point R with a arrival volume Pm during the 
third group(0.2 - 0.3 Ms), then the mean volume data 
SRa is computed according to : 
SRa = Pm/N 

Subsequently, to interpolate data to the mean 
volume data SRa thus calculated, the data transduc- 
ing unit 17 applies the mean volume data of each 
group to the intermediate point of the corresponding 
group. Then, as is shown in Fig. 8(c), the tops of each 
bar in the graph representing the mean volume data 
of the groups are linked, so that an approximate line 
will be formed. By using this approximate line, the 
data converting unit 17 interpolates as many new 
lines as the actual arrival N sound rays in the corre- 
sponding group. As a result of this data interpolation, 
the echotime pattern of an approximate line as is 
shown in Fig. 8(c) is formed. This interpolation is not 
limited to the approximation by a line; a curve may be 
used instead of a line, or an addition of a weight cor- 
responding to the arrival time to each sound ray also 
will do. 

The optimal effects are obtained when At is set to 
a corresponding value to a sampling frequency of the 
audio equipments such as compact disc player; for 
example, the optimal At for a sampling frequency of 
44.1 KHz is 22.7 Ms. 

The echotime pattern thus computed is stored 
into the memory 18, and read out for further process- 
ing at the sound field reproducing unit 2. 

Fig. 9 provides a detailed construction of these 
two components. The sound field reproducing unit 2 
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comprises an impulse response computing unit 21 for 
reading out the echotime pattern from the memory 1 8 
to compute an impulse response, a location data input 
unit 22 for reading out the data of the location of the 
listener within the model space; the location data are 5 
detected by a location data detecting unit 31 such as 
the VR equipment in the output unit 3, a head transfer 
function storing unit 23 for storing a predetermined 
head transfer function, a dry source input unit 24 for 
inputting data related to a dry source of a sound(the 1 o 
sound recorded in an anechoic room) to be repro- 
duced, a reproduced sound generating unit 25 for 
generating a consecutive sound signal by convoluting 
data related to the impulse response and head trans- 
fer function on the data related to the dry source with is 
a plurality of digital signal processors(DSPs). 

As is shown in Fig. 10, the impulse response 
computing unit 21 includes a echotime pattern input 
unit 41 for inputting data related to the echotime pat- 
tern for each location in the model space, each inci- 20 
dent direction, and each frequency band, a convolu- 
tion computing unit 42 for convoluting the echotime 
pattern of each frequency band by a bandpass filter, 
an impulse response computing unit 43 for computing 
the impulse response by compositing responses from 25 
all the frequency bands, an impulse response output 
unit 44 for outputting the impulse response for each 
location and incident direction, and a memory 45 for 
storing data related to the impulse response. 

The output unit 3 includes a sound output instru- 30 
ment 32 such as a headphone, over which a sound 
based on the consecutive signal from the reproduced 
sound generating unit 25 is reproduced, so that the 
listener can hear it 

In practice, a RB2(Reality Built for 2, a trade 35 
name) system or an Eyephone system of VPL Re- 
search Inc, and POLHEMUS are used for the location 
data detecting unit 31. In the Eyephone system, a 
sensor placed on top of the listener's head detects his 
location and his head's direction to output the related 40 
data to the sound field reproducing unit 2 on real time. 

The above described sound field reproducing unit 
2 and output unit 3 operate in the following way. 

The impulse response computing unit 21 com- 
putes the impulse response for each location and in- 45 
cident direction (listener's head direction) from the 
echotime pattern. 

The flowchart in Fig. 11 details how the impulse 
response is generated from the echotime pattern. 

In Step 300, the impulse response computing unit so 
21 reads out the echotime pattern sequentially from 
the memory 18, and in Step 320, it computes a re- 
sponse for each frequency band by convoluting each 
frequency by a bandpass filter. Consequently, the im- 
pulse data related to all the locations in the model 55 
space and incident direction are computed and stored 
in the memory 45. 

Once the impulse data are computed, the sound 
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field reproducing unit 2 shifts to a sound reproducing 
process, which is detailed by the flowchart in Fig. 12. 

In Step 400, the sound field reproducing unit 2 
reads out the location data from the location data in- 
put unit 22 on real time. Then, the impulse response 
input unit 41 reads out the impulse response data cor- 
responding to the location data from the memory 45 
in Step 410. Further, it reads out the head transfer 
function data from the head transfer function storing 
unit 43 corresponding to the location data as to the 
listener's head direction in Step 420. As previously 
mentioned, the head transfer function is a parameter 
that represents the change in an incident sound in ac- 
cordance with the shape of the listener's head and a 
location of his ears, and stored in the head transfer 
function storing unit 43 in advance. 

Subsequently, in Step 430, the reproduced 
sound generating unit 25 receives the dry source of 
the sound from the dry source input unit 24, and con- 
volutes the impulse response data on head transfer 
function data with the DSPs to generate a consecu- 
tive sound signal, which is outputted to the sound out- 
put unit 52 on real time and transduced into a sound 
in Step 440. 

As a result, the listener can hear a realistic, ster- 
eophonic sound as if he were in the model space. 

[Second Embodiment] 

The sound environment simulator in accordance 
with the second embodiment is detailed in Fig. 13. 
The essential construction thereof is identical with 
the simulator of the first embodiment except that the 
sound environment analyzing unit 1 includes the 
echotime pattern computing unit 15 and impulse re- 
sponse computing unit 21; that the impulse response 
data for every location are computed with a comput- 
ing server and stored into a memory in advance; and 
that the sound field reproducing unit 2 reads out the 
impulse response data and a head transfer function 
corresponding the location data from the memory to 
reproduce the stereophonic data from the dry source 
on real time. Otherwise, like components are labeled 
with like reference numerals with respect to the first 
embodiment, and the description of these component 
is not repeated. 

[Third Embodiment] 

The sound environment simulator in accordance 
with the third embodiment is detailed in Fig. 14. The 
essential construction thereof is identical with the 
simulator of the first embodiment except that the 
sound environment analyzing unit 1 includes the head 
transfer storing unit 23 and a composite response 
data computing unit 26. The composite response data 
computing unit 26 convolutes the head transfer func- 
tion data and impulse response data to compute the 
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composite response data in advance, and according- 
ly, the sound reproducing unit 24 convoiutes the com- 
posite response data for each head direction into the 
dry source on real time with the DSPs. Otherwise, 
like components are labeled with like reference nu- 
merals with respect to the first embodiment, and the 
description of these component is not repeated. 

With the simulator constructed as above, the 
number of the DSPs can be decreased as the number 
of incident directions increases. At the same time, 
less the data amount to be transferred to the DSPs 
becomes, faster t he sound environment simulator can 
correspond to the dynamic changes of the listener. 

As has been explained, computing the time ser- 
ies data of the arrival volume enables a precise pre- 
diction of the reverberant time. It also allows an accu- 
rate computation of the frequency characteristics of a 
reverberant sound. Thus, one or a few DPSs can also 
serve as a delaying circuit when the time length of the 
reverberant sound and the frequency characteristics 
are analyzed and approximated. As a result, the real- 
istic sound field can be reproduced by using less 
DSPs without impairing the listener's feeling of his 
presence in the model space. 

The reflected sounds are divided into the lower 
order reflections and higher order reflections and 
analyzed by the respective computation methods to 
enhance the work efficiency of the memory. How- 
ever, the algorithm used for the higher order reflec- 
tions can be used to all of the reflected sounds. 

In all the three embodiments, the sound environ- 
ment simulator is designed to simulate the sound en- 
vironment which adequately corresponds to the 
changes occurring when the listener sits, stands up, 
walks around or moves his head. However, it may be 
designed to apply to a specific situation alone. 

If the sound environment simulator is to be ap- 
plied to a case where the listener do not change his 
position, the sound receiving point R can be fixed to 
a single point, which obviates the location data de- 
tecting unit 31 and location data input unit 22, contri- 
buting to simplifying the construction. 

If the sound environment simulator is to be ap- 
plied to a case when the listener moves his head in 
the same position, the sound receiving point R can be 
fixed to a single point as well, and the location data 
detecting unit 31 is only to detect the directional 
change of the listener's head. Hence the amount of 
data used for computation decreases, which results in 
enhancing the overall operation speed. 

If the sound environment simulator is to apply to 
a case when the listener changes his position as he 
walks around, the heightfrom the floor level tothe lis- 
tener's ears have a constant value. Therefore, the 
three dimensional location data can be replaced with 
two dimensional data. Hence, the overall operation 
speed can be enhanced for the same reason descri- 
bed in the previous paragraph. 



With the sound environment simulator of the 
present invention, there may be a plurality of virtual 
sound sources, and even when they change their lo- 
cations, the realistic, stereophonic sound can be re- 

5 produced as well; for it reproduces an adequate 
sound field by adding the impulse response data for 
each incident direction accordingly. 

The confined space was created as the virtual 
space in all the embodiments; however, it can be an 

10 open space if equations for the open space are used 
to compute the echotime patterns. Also, the present 
invention enables the computation of the arrival vol- 
ume of the sound of the higher order reflections as 
has been described. Further, it can transduce the 

15 echotime pattern into the impulse response data in 
accordance with the listener's arbitrary position and 
head direction. Consequently, the present invention 
reproduces the realistic sound field by means of the 
existing VR equipment, which improves efficiency in 

20 designing for an audio and living room. 

Although the present invention has been fully de- 
scribed by way of example with reference to the ac- 
companying drawings, it is to be noted that various 
changes and modification will be apparent to those 

25 skilled in the art. Therefore, unless otherwise such 
changes and modifications depart from the scope of 
the present invention, they should be construed as 
being included therein. 



30 



Claims 



1 . A sound environment simulator comprising: 

echotime pattern computing means for 
35 computing an echotime pattern of a space to be 
analyzed by a geometric method based on the 
theory of acoustics with input data as to condi- 
tions of said space; 

impulse response computing means for 
40 computing an impulse response by computing a 
response for each frequency band from said 
echotime pattern and compositing all of said re- 
sponses together; 

sound field reproducing means for gener- 
45 ating reproduced sound data by convolution of 
said impulse response on non-reverberant sound 
source data; and 

output means for outputting a sound by 
transducing said reproduced sound data into the 
so sound. 

2. The simulator of Claim 1, wherein said echotime 
pattern means includes: 

analysis data setting means for setting 
55 analysis data by receiving analysis condition data 
including a shape and physical data of walls of 
said space, dividing said walls into a set of certain 
sections, and setting a virtual sound source and 
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a virtual sound receiving point at respective arbi- 
trary positions within said space; 

time series data computing means for 
computing time series data related to arrival vol- 
ume of a sound emanated from said virtual sound 
source to said virtual sound receiving point; and 

data transducing means for transducing 
said time series data related to the arrival volume 
into the echotime pattern by certain data interpo- 
lation. 

3. The simulator of Claim 2, wherein said sound field 
reproducing means includes: 

dry source input means for inputting the 
non-reverberant sound source data; 

head transfer function storing means for 
storing data related to a head transfer function; 

reproduced sound generating means for 
generating data related to a reproduced sound by 
convolving said impulse response from said im- 
pulse response computing means and said head 
transfer function from said head transfer function 
storing means on said non-reverberant sound 
source data from said dry source input means. 

4. The simulator of Claim 3, wherein said sound field 
reproducing means further includes: 

location data detecting means for detect- 
ing data related to at least one of a listener's head 
location and a listener's head direction; 

wherein said reproduced sound generat- 
ing means extracts said impulse response and 
said head transfer function corresponding to said 
detected location data to convolute them on said 
non-reverberant sound source data. 

5. The simulator of Claim 4, wherein said location 
data detecting means detects time varying data. 

6. The simulator of Claim 4, wherein said output 
means comprises a headphone. 

7. The simulator of Claim 1, further comprising: 

head transfer function storing means for 
storing data related to a head transfer function; 
and 

composite response generating means for 
computing a composite response for each direc- 
tion of a listener's head by convolution of said im- 
pulse response and said head transfer function, 
wherein 

said sound field reproducing means gen- 
erates reproduced sound data by convolution of 
said composite response on the non-reverberant 
sound source data. 

8. The simulator of Claim 2, wherein said time series 
data computing means computes form factors to 



compute the arrival volume of the sound to the 
sound receiving point by using said form factors 
and a sound absorption coefficient of each sec- 
tion included in said physical data of the walls. 

5 

9. A sound environment simulator comprising: 

analysis data setting means for setting 
analysis data by receiving analysis condition data 
including a shape and physical data of walls of 

10 said space, dividing said walls into a set of certain 
sections, and setting a virtual sound source and 
a virtual sound receiving point at an arbitrary pos- 
ition within said space; and 

echotime pattern computing means for 

15 computing an echotime pattern at a receiving 
point of a sound emanated from a sound source 
placed arbitrary in a space to be analyzed. 

10. The sound environment simulator of Claim 9, 
20 wherein 

time series data computing means for 
computing time series data related to arrival vol- 
ume of a sound emanated from said virtual sound 
source to said virtual sound receiving point; and 
25 data transducing means for transducing 

said time series data related to the arrival volume 
into an echotime pattern by certain data interpo- 
lation. 

30 11. The sound environment simulator of Claim 10, 
further comprising: 

impulse response computing means for 
computing an impulse response by computing a 
response for each frequency band from said 

35 echotime pattern by compositing all of said re- 
sponses. 

12. The sound environment simulator of Claim 11, 
further comprising: 
40 composite response generating means for 

computing a composite response for each direc- 
tion of a listener's head by convolution of said im- 
pulse response and said head transfer function. 

45 1 3. A sound environment simulator comprising 

sound field reproducing means for gener- 
ating reproduced sound data by convolution of 
non-reverberant sound source data and impulse 
response data; and 

50 output means for outputting a sound by 

transducing said reproduced sound data into the 
sound. 

14. The sound environment simulator of Claim 13, 
55 wherein said sound field reproducing means in- 
cludes: 

dry source input means for inputting the 
non-reverberant sound source data; 
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head transfer function storing means for 
storing data related to a head transfer function 

location data detecting means for detect- 
ing data related to at least one of a listener's head 
location and a listener's head direction; and 

reproduced sound data generating means 
for generating data related to a reproduced sound 
by extracting and convoluting said impulse re- 
sponse and said head transfer function corre- 
sponding to said detected location data on said 
non-reverberant sound source data. 

1 5. A met hod of analyzing a sound space, comprising 
the steps of: 

setting analysis conditions including a 
shape of a space to be analyzed and physical 
data of walls thereof, a set of certain sections by 
dividing the walls, and a virtual sound source and 
a virtual sound receiving point; 

computing time series data related to arriv- 
al volume of a sound emanated from said sound 
source to said sound receiving point for each in- 
cident direction and frequency band; and 

computing an echotime pattern by certain 
data interpolation to said time series data. 

1 6. The method of Claim 15, wherein the step of com- 
puting time series data includes the steps of: 

computing data related to the arrival vol- 
ume of the sound emanated directly from said 
sound source to said sound receiving point: 

computing data related to the arrival vol- 
ume of the sound arriving at said sound receiving 
point and another section by reflecting for up to 
a predetermined number of times by using a 
sound absorption coefficient of each section in- 
cluded in said physical data of the walls and form 
factors; 

computing data related to the arrival vol- 
ume of a sound arriving at said sound receiving 
point by reflecting for more than a predetermined 
number of times by using the sound absorption 
coefficient of each section included in said phys- 
ical data of the walls and form factors; and 

computing time series data by dividing 
said arrival volume data into a set of groups by a 
certain time interval. 



18. A step of analyzing a sound space, comprising 
the steps of: 

computing an echotime pattern for each 
frequency band at a virtual sound source placed 

5 arbitrarily in a space to be analyzed by a geomet- 

ric method based on the theory of acoustics; 

computing impulse response by convolut- 
ing said echotime pattern for each frequency 
band by a bandpass filter to compute a response 

10 for each frequency band and by compositing said 
responses all together to compute an impulse re- 
sponse; 

detecting data related to a listener's loca- 
tion; 

15 generating data related to a reproduced 

sound by receiving a dry source of said sound 
source, and by convoluting said impulse re- 
sponse and a head transfer function on said dry 
source; and 

20 outputting a sound by transducing said re- 

produced sound data in the sound. 

19. The method of Claim 18, wherein in the step of 
detecting data related to the listener's location, 

25 data related to dynamic changes of the listener's 
position and the direction of his head are detect- 
ed as the location data. 

20. The method of Claim 18, wherein in the step of 
30 detecting data related to the listener's location, 

data related to directional changes of the listen- 
er's head are detected as the location data. 



35 



40 



45 



17. The step of Claim 16, wherein in the step of com- 
puting data related to the arrival volume of a so 
sound arriving at said sound receiving point by re- 
flecting for more than a predetermined number of 
times, a new virtual sound source is set by inte- 
grating said arrival volume data of each group, 
and the arrival volume of sounds emanated from 55 
said new virtual sound source to any of the sec- 
tions are repeatedly computed. 
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Fig.13 
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Fig.14 



12 

jL 



SONUD 

SOURCE 

DATA 

INPUT 

UNIT 



13 



SOUND ENVIRONMENT 
ANALYZING UNIT 



14 



SOUND 
RECEIVING 
POINT 
DATA 

INPUT UNIT 



± 



SURFACE 
DIVIDING 
UNIT 



J 



ECHOTIME PATTERN 
COMPUTING UNIT 



^5 



IMPULSE RESPONSE 
COMPUTING UNIT 



21 



26 



COMPOSITE 
RESPONSE 
COMPUTING UNIT 



23 

-a, 



HEAD RELATED 

TRANSFER 

FUNCTION 

STORING 

UNIT 



1 



LOCATION 
DATA INPUT 
UNIT 



1 



SOUND FIELD 
REPRODUCING UNIT 



REPRODUCE 
SOUND 
GENERATING 
UNIT 



U24 



DRY SOURCE 
INPUT UNIT 



LOCATION 
DATA 

DETECTING 
UNIT 



31 



SOUND OUTPUT 
EQIPMENT 

^ 



^32 



24 



EP 0 593 228 A1 



Kuropcan Patent 

omcc 



EUROPEAN SEARCH REPORT 



Application N amber 

EP 93 30 8041 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Ckatioa of document with indication, where appropriate, 
of relevant passages 



Relevant 
to < 



CLASSIFICATION OF THK 
APPUCATION (lnt.Cl.5) 



A 
A 



US-A-4 928 25Q (GREENBERG ET AL.) 

* column 2, line 26 - line 35 * 

* column 2, line 41-45 * 

* column 8, line 38 - column 9, line 40 * 

* column 9, line 45-56 * 

* column 9, line 67 - column 11, line 11 * 

* column 12, line 45 - column 14, line 13 



PATENT ABSTRACTS OF JAPAN 

vol. 13, no. 395 (P-927)4 September 1989 

& JP-A-11 041 321 (MATSUSHITA) 2 June 1989 

* abstract * 

PATENT ABSTRACTS OF JAPAN 

vol. 15, no. 176 (P-1198)7 May 1991 

& JP-A-30 038 695 (SHIMIZU) 19 February 

1991 

* abstract * 

EP-A-0 432 973 (MATSUSHITA) 



1-20 



H04S5/00 
G10H1/00 



1-20 



13,14 



1-3,18 



1-3, 

9-11, 

13-18 



TECHNICAL FIKIJJS 
SEARCHED (lDt.CI.5) 



H04S 
G10H 
G10K 
G06F 
H04R 



The present search report has been drawn up for all claims 



Place • < fceock 

THE HAGUE 



DsUofcu»ldiuoftfce ttmxM 

24 January 1994 



Zanti, P 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if taken alone 

Y : particularly relevant if combined with another 

document of the same category 
A : technological background 
O : dob- writ ten disclosure 
P : intermediate document 



T : theory or principle underlying the Invention 
F. : earlier patent document, but published oa, or 

after the filing date 
D : document cited in the application 
L : document cited for other reasons 

4 : member of the same patent family, corresponiing 
document 



25 



